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ABSTRACT 


Let  us  consider  a  linear  program  with  several 
objective  functions.  The  traditional  approach 
has  been  either  to  "trade  off"  by  weighting  each 
function,  or  if  a  "trade  off"  vector  cannot  be 
provided  to  ignore  all  but  the  most  significant. 

We  are  interested  in  classes  of  programs  whose 
.members  possess  some  common  characteristics. 
Examples  are  sequences  of  production,  refining, 
inventory  problems  over  time  at  one  installation. 

If  sufficient  conditions  exist  an  estimate  of 
a  "trade-off"  vector  can  be  made.  This  estimate 
improves  over  the  sequence. 

* 

A  set  X  exists  which  contains  the  solutions 
obtained  by  optimizing  with  respect  to  all 
nonnegative  combinations  of  objective  functions. 

A  decision  maker  is  not  indifferent  to  these 
solutions  but  can  characterize  preferred  solutions. 
A  method  is  presented  whereby  he  can  direct  ^ 
finite  sequence  of  solutions,  (x.),  over  X,f 
towards  a  preferred  solution.  As  the  estimate 
of  the  "trade-off"  vector  improves,  the  expected 
length  of  the  sequence  (x.)  diminishes,  and 
the  efficiency  of  solution  increases. 


1.  Introduction 


In  this  paper  we  will  investigate  linear  programs  with  more  than  one 
objective  function: 

(1)  Objective  function  z  =  Qx 

subject  to  Ax  =  b 
x  >  0 

where  z  is  a  p-vector 
x  an  n -vector 
b  an  m-vector 

Q  a  p  x  n  matrix  =  (c  ,..,c  ,..,c  ) 

A  an  n  x  m  matrix. 

We  will  defi.ie  a  preferred  set  S  such  that  only  if  x  is  in  S  will  the 
objective  be  satisfied.  Under  certain  conditions  a  semipositive  linear  transformation 
(x)  on  z  ca.i  be  made  such  that  XQx  will  be  minimized  and  the  minimizer  x° 
will  be  in  S  .  We  will  define  a  set  Z  of  weakly  undominated  z  and  show 
that  under  arbitrary  X 

min  XQx  and  z  =  Qx  ,  z  e  Z 
x 

will  be  attained  by  the  same  x  .  Also  for  any  x'  such  that  Qx'  is  not  in 

1  2 
Z  ,  Qx  can  be  strictly  decreased  to  a  point  Qx  which  is  in  Z  .  Hence  the 

simplex  method  will  always  yield  points  in  Z  as  optimal  basic  feasible  solutions. 

Having  established  that  arbitrary  X  will  produce  an  extreme  point  x  from 
a  set  of  extreme  points  which  also  contains  a  preferred  extreme  point  (assuming 
hopefully  that  S  contains  an  extreme  point!)  we  will  find  a  X°  which  will 
yield  the  desired  x  in  S  .  For  this  we  make  certain  assumptions,  in  particular 
that  X  is  statistically  estimable.  If  an  immediate  solution  is  not  found  an 
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algorithm  is  used  to  search  for  the  preferred  extreme  point  while  minimizing 
the  squared  deviation  of  X  from  its  estimate.  . 

The  assumption  that  X  is  estimable  is  not  unrealistic  if  the  approach 
taken  in  this  paper  is  applied  to  a  class  of  problems  with  certain  similarities, 
for  example:  production  planning  over  sequential  periods  where  decisions  are 
made  at  each  period. 

2.  The  Presentation  of  the  Problem. 

The  objectives  of  many  linear  programs  can  be  defined  adequately  only  as 
vector  functions.  For  example,  in  addition  to  minimizing  cost,  a  decision 
maker  might  also  wish  to  minimize  execution  time  of  a  project;  or  to  maximize 
employment,  etc.,  or  any  combination  of  these. 

k 

Suppose  that  there  exist  p  objective  functions  zk  ■  c  x,  k*l,.  .  .  ,p  ,  to 
a  linear  program  subject  to  the  constraint  x  e  T  where  T  *  {x|Ax  *  b,  x  >  0,  x  e  R°}. 
We  will  assume  throughout  this  paper  that  T  is  nonempty  and  bounded.  In  general 
no  x°  e  T  exists  such  that  zk°  =  c^x0  is  an  optimum^  for  all  k  .  We  construct 

the  multiple  objective  vector  function  z  =  (z^,.  .  .  ,z^ . Zp)  €  RP  .  After 

we  exclude  the  case  just  mentioned,  it  is  obvious  that  z  cannot  be  minimized. 

Although  other  approaches  can  no  doubt  be  taken,  it  seems  both  legitimate  and 
consistent,  since  the  subject  is  linear  programming,  to  transform  z  to  a 
scalar  function  which  lends  itself  to  minimization. 

We  define  a  pair  of  both  physical  and  mathematical  significance:  the  decision 
maker  (DM)  and  the  linear  program  problem  solver  (LP)  .  First,  mathematically, 

DM  is  a  function  from  RP  to  R  with  value  Xz  transforming  the  components 
of  z  by  semipositive  linear  combinations  to  a  scalar  objective  function.  LP 
is  a  correspondence  from  R  to  T  :  given  a  real  valued  linear  objective  function 

^Optimum  is  used  to  mean  maximum  or  minimum.  In  subsequent  sections  the  minimum 
problem  only  is  treated. 
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DM(z)  ,  x  e  LP(DM)  c  T  such  that  OH  is  minimized.  We  call  such  x  an 
optimal  solution.  If  the  decision  maker  is  satisfied  with  some  optimal  solution 
and  terminates  the  problem,  the  solution  is  defined  to  be  preferred.  If  he  is 
unsatisfied  but  no  feasible  optimal  solution  satisfies  him  more,  then  the  solution 
is  almost  preferred.*  Clearly,  the  latter  definition  implies  that: 

Given  the  existence  of  one  of  the  solutions, 
either  a  preferred  solution  or  an  almost 
preferred  solution  exists,  but  not  both. 


We  shall  prove  in  Section  k  that  under  certain  conditions  one  of  these  solutions 
does  indeed  exist.  A  solution  which  is  either  preferred  or  almost  preferred 
will  be  abbreviated  to  a  POAP  solution.  No  implication  has  been  made  as  to  the 
uniqueness  of  any  solution,  only  to  the  uniqueness  of  a  set  of  solutions. 

Secondly,  physically,  the  problem  thus  far  stated  (l)  can  be  decomposed 
between  DM  and  LP  .  We  can  consider  that  DM  generates  by  so*e  means  a 
vector  of  weights  by  which  he  constructs  a  linear  combination  of  objective 
functions.  He  has  then  produced  a  linear  program  for  LP  to  solve.  LP  , 
characteristically  a  computer,  can  produce  an  optimal  feasible  solution  by 
conventional  linear  programming  techniques. 


^The  concept  "satisfied"  is  unmathemat ica 1  intuitively  and  undefined  explicitly. 
In  the  light  of  the  assumption  DM2  appearing  at  the  end  of  the  section  we  can 
define  the  following: 

(i)  DM  is  satisfied  if  he  does  not  specify  any  vector  d  ,  given  x  . 

(ii)  DM  is  unsat i sf ied  if  he  specifies  some  vector  d  ,  given  x  . 

(iii)  DM  is  unsatisfied  but  no  x1  satisfies  him  more  if  he  specifies  some 
vector  d  ,  given  x  ;  but  no  x1  exists  such  that  d(x' ,S)  <  d(x,S)  . 

Both  the  decision  maker  and  the  decision  maker  function  will  be  called  DM  for 
notational  simplicity.  Similarly,  both  the  linear  program  problem  solver  and 
its  correspondence  will  be  called  LP  .  No  ambiguity  will  occur. 


0  i* 
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(Recall  that  T  is  nonempty  and  bounded.)  DM  now  evaluates  the  solution. 

If  he  is  satisfied  he  terminates  the  problem;  otherwise  he  tries  a  new  vector 
and  sends  the  data  back  to  LP  . 


Suppose  a  common  unit  could  be  established  in  which  the  value  of  z^  would 
be  expressed.  Then,  in  the  above  example,  DM  could  assign  units  of  value 

to  one  unit  of  cost,  ^  units  of  value  to  one  unit  of  execution  time,  etc., 
and  all  the  components  would  be  transformed  to  a  unique  additive  measure  p, 
in  units  of  value,  p.  =  cy'z  ,  where  a  is  well  defined  and  constant.  We  shall 
require  that  X  be  normalized  so  DM(z)  =  a'z/||a'|l  >  which  would  then  be 
completely  determined.  The  problem  would  then  reduce  to  a  conventional  linear 
program.  We  will  assume  that  the  decision  maker  cannot  establish  such  a  unit 
of  value. 


We  can  now  define  (l)  more  explicitly: 

(2)  Find  (x,  DM)  ,  x  €  T  ,  DM  e  <fzk}>+t  such  that  x  e  LP(DM)  and  x  POAP  . 


Equivalently: 

(2 1 )  min  DM  =  XQx 

x 

subject  to  Ax  =  b 
x  >  0 
x  POAP 
P 

for  each  X  >  0  ,  E  X.  *  1 

k=l 

whe re  Q,  ~  (c  ,.  »  .,c  ,.  .  • , c  )  .  t 


*"For  each  X"  seems  to  imply  that  the  set  of  X  is  at  most  countable,  which  is 
not  true.  However  in  Section  6  we  will  show  that  there  exist  a  finite  number  of 
sets  A-  »  and  ar,y  X  e  Aj  will  generate  the  same  solution  set  {x}  as  any 

X1  e  A.  .  Thus  "for  each  X"  is  to  be  interpreted  "for  any  X  from  each  A-*’ 

uj  I 

^^"<{z^}>"  reads  "the  convex  hull  of  the  set  of  all  z^. 


II 
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We  will  approach  (2*)  eventually  as  a  two  stage  problem:  firstly,  for  some  X  , 
minimizing  DM  ;  secondly,  determining  the  given  so'ution's  POAP  properties, 
and  revising  X  if  necessary.  Call  then  the  first  stage,  i.e.  (2 1 ) ,  neglecting 
the  x  POAP  condition:  (211)* 

In  Section  3  we  will  prove  that  solutions  to  (2M)  exist  under  certain 
conditions,  and  that  the  simplex  method  will  find  a  subset  of  these  solutions. 


The  method  proposed  for  finding  a  solution  has  little  practical  significance 
for  a  single  problem,  since  the  value  cf  X  needed  to  obtain  a  POAP  solution 
is  known  only  after  the  POAP  solution  has  been  found.  (This  is  clear  from 
the  definitions  of  preferred  and  almost  preferred.)  However,  if  we  have  a 
class  (?  of  problems  possessing  certain  properties,  and  the  first  T-l  sequential 
problem  can  be  solved  more  efficiently  when  LP  has  available  the  values 

,  t=l,...,T-l  ,  used  to  obtain  the  respective  POAP  solutions,  than  otherwise. 
The  required  properties  are: 


Let  Ct  e  (3  be  the  tt^  sequential  problem  of  form  (2 1 )  possessing  a 
POAP  solution. 


a)  Let  T  =  T  for  C  .  Then  0  T  t  t  where  t  is  the  index  set 

t  t  £  L 

{1.2,...}  . 

b)  Let  xt  =  x  e  T  for  Ct  .  Then  xfc  e  R°  V  t  and  £  x^.  e  Rn  • 

V.  it 

c)  If  x  is  preferred  for  some  ,  and  if  x  is  optimal  for  some 

* 

Cj.,  ,  t  /t,  then  x  is  preferred  for  ,  .  Equivalently 
c1)  There  exists  a  domain  Sc  R  such  that  if  optimal  x^  e  S  it  is  preferred. 

d)  z  is  common  to  Ct  ,  V  t  . 

e)  The  distribution  of  T  is  such  that  a  maximum  likelihood  estimate  of 
X  exists.  This  estimate  is  the  mean  of  X  over  t  . 
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Now  we  require  some  assumptions  on  LP  and  on  DM  .  Our  recognition  of 
LP  as  a  linear  programming  problem  solver  should  be  sufficient:  we  know  that 
it  will  read  and  interpret  submitted  data  without  error,  that  it  will  produce 
an  optimal  feasible  solution  with  certainty,  and  that  it  will  yield  DM  the 
results  with  typographic  perfection.  As  for  DM  we  assume  the  following: 

DM1  (Recognition).  DM  can  always  recognize  an  optimal  solutions  x  e  S  to  be 
preferred.  He  can  always  recognize  an  optimal  solution  x  i  S  to  be  not 
pre  ferred. 

DM2  (Direction).  Given  an  optimal  solution  x  l  S  ,  let  the  distance  between  x 
and  the  closest  point  in  S  be  d(x,S)  .  Then  DM  can  specify  a  vector  d 
such  that  d(x  +  ed,  S)  <  d(x,S)  for  arbitrarily  small  e  >  0  .  No 
knowledge  of  any  point  s  e  S  is  assumed. 

Using  the  assumptions  DM  will  be  able  to  direct  LP  towards  S  and 
terminate  if  LP  produces  x  e  S  . 

3 .  The  Existence  of  a  Solution. 

We  define  a  vector  z°  to  be  weakly  undominated  if  z  z°  ^  in  the  domain 
of  z  .  This  definition  will  enable  us  to  replace  the  scalar  "minimize"  by  the 
vector  "find  weakly  undominated"  in  the  vector  optimization  problem: 

(3)  Find  weakiy  undominated  z  =  Qx 

subject  to  Ax  =  b \ 

I  or  x  e  T 
x  >  0) 

where  symbols  are  defined  in  (1)  . 

^"z  <£  z°"  reads  "it  is  not  true  that  z^  <  zk°  ,  k=l . . 
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We  can  r>w  find  a  set  of  x  which  will  solve  (3). 

.  *  _  min  k  min  k  .  r 

Let  z  be  any  vector  z  such  that  z^  <  z^  ,  for  any  z  in 

m in  Ic 

the  range  of  x  .  Then  z  is  weakly  undominated.  Thus  we  can  produce 

p  such  weakly  undominated  vectors,  each  of  which  is  minimal  in  one  component. 

m in  k 

h'ow  can  we  produce  the  inverse  images  of  such  z^  ?  Consider  one  such  problem- 

(4)  min  z  =  Qx  ,  x  e  T 

w.  r . t .  k 


Clearly  z^(  ,  k'  ^  k  ,  can  adopt  any  value  and  is  independent  of  the  minimizing 
process.  Hence  (4)  is  equivalent  to 


(5) 


min  z^  =  c  x  ,  x  e  T 


which  is  a  linear  program.  Hence  by  solving  p  linear  programs  of  form  ^5)  we 

can  find  p  basic  feasible  solutions  to  (3).  each  of  which  has  the  minimal 

/  \  k* 

property  in  a  different  component.  Call  a  feasible  solution  to  (5)  x 

("Solution"  is  hrre  used  according  to  the  linear  programming  convention  to 

mean  a  value  of  x  at  which  the  objective  is  minimized.  No  ambiguity  results. 

(<*V  |<fv 

All  solutions  are  assumed  feasible.)  Let  X  =  {x  }  .  From  we  1 1 -known  results 

i<* 

X  is  convex. 


Now  to  dispose  of  the  simplest  case: 


k* 


Theorem  1  (3)  has  a  minimum  solution  x  if  and  only  if  £  X  4  to  ,  and  any 


Proof 


point  in  the  nonempty  intersection  is  such  a  solution. 

■irk  .  .  irk  irk 

Suppose  x  is  a  minimum  solution  to  (3).  Then  z  =  Qx  is 

irk 

not  only  weakly  undominated  but  also  a  minimum.  Hence  z  <  z  ,  x  e  T  . 


It  follows  that  z,  ^  2l.  »  k=l 


x  solves  (5)  for 


so 


k* 


each  of  the  components,  and  x  =  x  ,  k=l,...,p  .  Consequently 

x  e  X^  for  all  k  ,  and  x  e  0  X^  .  Suppose  HX^  4  t  .  Let 

k 


P  +* 
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x°  e  nX*°V  .  Then  x°  solves  (5)  for  each  of  the  components, 

Qx°  *  z°  <  z  ,  x  e  T  ,  z°  is  a  minimum  vector  and  x°  solves  (3) 
to  a  minimum.  x°  was  chosen  arbitrarily  from  rT,  so  any 
x°  e  OX**  solves  (3).  Ill 


Now  a  minimum  solution  to  (3)  seems  the  best  we  can  hope  for,  and  indeed 

will  solve  (2 1 )  provided  we  can  show  that  it  is  POAP  .  Theorem  3  will  give  us 

k* 

that  answer.  Meanwhile  let  us  consider  the  case  where  QX  «  t  .  We  have 
shown  that  there  is  no  minimum  solution  to  (3). 


k* 

Ncw  we  have  shown  that  a  set  ^JX  of  solutions  to  (3)  exists,  and  we 
would  like  to  discover,  if  possible,  a  maximal  such  set  from  which  to  select 
some  preferred  or  almost  preferred  x  .  Also,  since  we  have  the  simplex  method 
in  mind,  we  would  like  to  know  if  we  can  move  from  x  to  a  better  x*  . + 

i<  itr  * 

We  will  show  that  this  maximal  set  X  exists  and  x  e  X  is  a  solution 

to  min  X  Qx  ,  x  «  T  ,  for  sof.’e  X  >  0  .  We  would  like  also  to  be  able  to 
x 

specify  X  and  thus  generate  a  specific  solution.  If  the  rows  of  Q  are  not 

positively  linearly  independent  we  can  find  some  X°  such  that  X°Q*  *  0  for 

all  x  e  T  !  Legislating  this  trivial  solution  out  of  existence  we  require: 

k  k 

Positive  linear  independence  of  c  ,  i.e.  I  X^c  • 

k 


We  can  now  construct  a  closed  convex  cone  Y  ■  {  <kQ'>  ,  k  >  0  ,  a 

k  tfr  it  .  i<  \ 

the  minimal  cone  containing  c  .  Let  X  B  fx  |  x  minimizes  c  x  ■ 

X  k*  *  X 

for  some  c  e  Y  }  .  Clearly  x  e  X  for  all  k  .  Also  for  any  c 

there  exists  the  corresponding  x  by  the  compactness  of  T  . 


scalar 

zx  •  x 

e  Y 


}  . 


e  T 


» 


^Analogously  to  linear  programming  we  can  say  that  x'  is  better  than  x  if 
z 1  =  Qx*  <  Qx  =  z  . 
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Theorem  2 


Proof 


If  there  exists  xL°  £  X' '  ,  x  e  T  ,  and  z°°  *  Qx°°  ,  where  Q 

is  a  matrix  of  p  positively  linearly  independent  rows,  the  k**1 
row  being  c  ,  there  exists  z  <  z  (i.e.  z^  <  z^  ,  k) 

O  '*r 

such  that  x  e  X  . 

x00  i  X". 

00  k  00  .  _  . 

(6)  Referring  to  (5):  z^00  >  z^'  else  x°°  e  X*0'  c  X~  . 

.  .  k  00  u  00 

p  hyperplanes  c  x  =  pass  thiough  x  .  Hence  there 

.  .  ,  ,  ,  k  00., 

exist  p  closed  han  -spaces  c  x  <  z^  with  nonempty  intersection 

rdt  ,  and,  by  the  positive  linear  independence  of  c^'  and  the 

compactness  of  T  ,  ^  has  an  interior.  (ir.tc^)  0  T  4  0  by  (6). 

It  is  necessary  and  sufficient  to  show  that  there  exists  x^  e 

(intc^)  P  T  satisfying  x°  e  X  since  x^  e  (intctf)  P  T  =»  z^  <  z^  . 


01 


Select  a  point  x"'  in  (int-o£)  0  T  .  Define  <&-  '  =  fx| c  x  <  z^  '  , 
Vk  }  .  Thenx^  ^  0  T  r  (intc*0  0  T  .  Construct  a  sequence 
x°°  ,  x01,..x01  such  that  (intcxO  P  T  ^Ptd.  .  .  ^L'  n  t  => 

•  •  .Dc'  >  T  are  closed,  so  '  P  T  is  closed.  \JL?  P  T  is  a 

decreasing  monotone  sequence  of  sets  so  1  imo^.'  P  T  =  P  ( p  T)  = 

0  0  ^  .  0I  =  1 
x^  .  x^  lies  on  a  supporting  hyperplane,  since  x^  lies  on  the 

boundary  of  T  ,  for  if  not  a  smaller  set  could  be  found  containing 

points  of  cxl  and  T  .  The  boundary  of  T  is  a  set  of  hyperplanes. 


So  x^  must  lie  on  at  least  one. 


Construct  p  -  1  other  different  sequences  yielding  x^  ( k=*  1 , . .  ,  p ) 
arbitrarily  close  and  lying  on  the  same  hyperplane.  Either  all  x^° 
are  different  or  1  i m  JL'  r  t  is  unique  over  all  sequences.  If 


o  o 
X1  =  X2 


I  -<O0 

o  o  o  r  o  _o,o 

.x,  .  .  .x  =  x  ,  for  any  x  +  Ax  e  T  ,  z  +  A  z  >  z 
k  p 


Hence  at  x  ,  z  attains  a  local  minimum.  By  the  linearity  of  the 
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space  and  every  objective  function,  a  local  minimum  is  global.  Hence 
x°  e  Xk  (for  all  k)  c  X 


If  all  xk  are  different  we  will  find  a  such  that 


a  z.  =  a  constant 


o'  *  Z  =  z  ,  a  constant  vector 
O  /  o 


t*r . rP0) 


Let  Z 


where  Z 

0,00  o, 

„  »  z.  , .  ,  .  ,z,  ) 


Then  (Z°  -  Zk°)  =  0  . 

Transposing,  and  by  Farkas1  Lemma 

(Z°  -  Z^0)  y  -  0  ,  0  .  y  <  0  has  no  solution 

therefore  (Z°  -  Zk°)'  <y  =  0  ,  <y  “  0  has  a  solution 

0  •  a'  (Z°  -  Zk°)  =  o'  (QX°  -  QXk°) 

[where  X°  *  (x^,  x2°  .  .  ,xp°) 

Xk°  ■  (xk°  ,  xk°  ,  .  .  . ,xk°)] 

-  cy'Q(X°  -  Xk°)  . 

But  (X°  -  Xk°)  is  a  (p  -  l)  -  tuple  of  vectors  in  one  supporting 
hyperplane,  so  v'(X^  -  X^)  =  0  is  the  equation  of  the  hyperplane, 

v  t  0  .  Therefore  Q'q-  =  v  ^  0  ,  and  cr^O.  ,  cr  0  =*  a  >  0  . 

0  0 
Now  o  Z  *  z  implies  that  at  each  xk  is  attained  the  value 

z  ■  q-'QX  ,  a  constant  on  the  boundary  hyperplane;  therefore  at 

xk^  is  attained  a  local  minimum.  By  the  previous  argument  it  is 

k 

also  global,  o 1 Q.  is  a  semipositive  linear  combination  of  c  ,  hence 


0  * 

a  Q  e  .  Consequently  xk  e  X 
from  the  conditions  of  Theorem  2  falls  out  tli3t 

Corollary  1  X  is  the  set  of  all  solutions  to  (2 1 ' ) 

Proof  X  =  fx  |x  minimizes  c  x  =  z.  ,  for  any  c  e  Y  ,  x  e  T]  . 


/// 


11 


By  the  convexity  of  V  ,  =  F  X.c  where  is  an  extrema  ray  of 

k  K 

V  and  >  0  ,  FX^  >  0  .  But  c  are  the  independent  rows  of  Q  , 

x  p 

so  c  =  £  X.c  where  X.  ,  =0  if  c^  is  dependent.  So  x 
k=l  K  k 


minimizes 
scalar  >  0 


XQx  ,  X  >  0 

.  Let  a  =  - 


x  also  minimizes 
1 


P 

F  X, 

k=l 


,  and  x 


aXQ*  where  a  is  a 
is  a  solution  to  (2 1 1 )  . 


Hence  X  is  the  set  of  all  solutions  to  (2 1 1 )  . 


/// 


We  have  now  found  ,  the  set  cf  all  solutions  to  (2 1 ' )  .  We  show  that 
(211)  then  is  equ:valent  to  (3)  and  a  search  for  a  weakly  undominated  z  replaced 
by  a  simple  linear  program.  Let  2  be  the  set  of  all  weakly  undominated  z  . 

Corol lary  2  x  e  X  if  and  only  if  z  e  Z  . 


Proof  Suppose  x  €  X"  .  Then  either 

(i)  at  least  one  component  of  z  is  minima’.  Then  z  is  weakly 
undominated;  or 

(ii)  cy'z  is  minimal  for  some  cr  >  0  .  Suppose  there  exists  some 

z  <  z  .  Then  o'z  <  z  which  contradicts  the  hypothesis. 

00  sv 

Suppose  z  e  Z  .  Then  z  <  z  £  1  and  x  e  X  by  Theorem  2.  Ill 


Thus  far  we  have  produced  a  set  of  solutions  X  ,  each  element  of  which  is 
equally  satisfactory.  The  choice  will  be  narrowed  by  restricting  (or  attempting 
to  restrict)  x  to  a  preferred  set  S  .  Now  that  we  know  that  the  search  for 
x  e  S  can  be  done  by  linear  programming  techniques  we  must  assume: 

,  .  1  *  2  * 

L P 1  (Finiteness).  Let  x  e  X  be  an  optimal  solution.  Then  x  e  X  ,  another 

optimal  solution,  can  be  produced  in  a  finite  number  of  steps. 


4. 


and  the 


Preferred  Set 


In  Section  2  we  have  assumed  the  existence  of  a  preferred  set  S  .  We  also 
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constructed  an  interaction  between  DM  and  LP  ,  whereby  LP  proposes  optimal 
solutions  to  a  linear  program,  and  DM  accepts  them  or  tries  to  steer  them 
towards  S  (assumptions  DM1  ,  DM2  ).  In  Section  3  we  showed  that  the  set  of 
points  that  LP  can  propose  is  indeed  that  set  of  points  from  which  DM  wishes 
to  select  a  preferred  point.  Now  what  about  S  ? 


In  this  paper  we  choose  not  to  make  any  assumptions  on  S  .  Such  assumptions 
would  involve  economic  concepts  such  as  insatiability  of  preferences,  convexity 
of  preferences,  etc.,  which  are  not  appropriate  here.  However,  it  is  important 

it 

to  grasp  that  although  LP  has  a  linear  objective,  to  find  some  x  e  X  ,  DM 
lias  no  such  thing.  Now  suppose  that  we  have  a  set  X  obtained  from  solving 
(2 1  1 )  or  from  solving  (3),  we  will  show  that  a  complete  solution  to  (2')  exists. 
Before  proving  the  next  theorem  we  require  a  lemma: 


Lemma  X  *  <X  >  fi  bdry  T 

Comment  We  proved  in  Theorem  2  that  X  c  bdry  T  .  We  now  require  that 

X  be  simply  connected  over  the  boundary  i.e.  that  there  be  no 
holes.  In  Theorem  3  we  will  have  sequences  of  solutions  starting 

it  it  it 

in  X  and  ending  in  X  .  These  sequences  must  stay  in  X 


Proof 


Let  x°  e  bdry  T  .  Then 

(A)  x°  *  E  pi.x.  ,  where  fi}  is  the  index  set  of  all  extreme  points 
of  T  contained  in  the  supporting  hyperplane  containing  x  ,  and 


M. 

Let 

(B)  x° 
of 
But 
if 


>  0  ,  £  (j, .  =  1  . 

it 

x  c  <  X  >  .  Then 

=  T.  Xj  Xj  .  where  [j]  is  the  index  set  of  all  extreme  points 

T  in  X*  ,  and  Xj  >  0  ,  Y.  x.  =  1 

the  extreme  point  representat ion  of  any  x  e  T  is  unique,  and 

x°  e  <  X  >  H  bdry  T  then  if  >  0  «  Xk  =  • 


Simi larly 
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if  Xj<  >  0  ,  X|<  -  (i^  .  Thus  the  extreme  points  of  (A)  are  the 
same  as  those  of  (B)  and  x  =  £  p.  x.  .  But  all  x.  ,  i  e  f  i } 
minimize  <y  Qx  for  some  <y  .  Hence  x°  also  minimizes  <>  Q*  » 
and  x°  e  X  .  Suppose  x°  e  X  .  Then  x°  e  <X  >  and  x°  g  bdry  T 

So  x  g  <X  >  p  bdry  T  and  X  =  <X  >  O  bdry  T  .  /// 

Theorem  3  will  show  under  what  conditions  a  preferred  solution  can  be  found. 

The  effects  of  pathological  circumstances,  those  in  which  the  linear  program 
and  the  decision  maker  are  opposed,  will  become  clear. 

The  lemma  has  shown  that  X  is  a  simply  connected  part  of  the  boundary 
of  T  ,  intuitively  a  partly  open  convex  set  without  an  interior.  |f  then  we 
required  conditions  for  a  preferred  solution  to  be  produced,  it  would  seem 
immediate  that  would  suffice  firstly:  convexity  of  S  ,  and  secondly: 

J- 

X  0  S  4  t  .  However  Figure  1  shows  a  case  where  these  conditions  are  insufficient. 
Using  the  decision  maker's  axioms,  and  starting  from  the  left  of  the  Figure,  almost 
preferred  solutions  are  encountered  twice,  at  x^  and  at  x^  before  a  preferred 
solution  is  reached  at  x^  .  Clearly  the  choice  between  x^  ,  ,  or  x^  is 

determined  by  the  original  trial  solution  and  the  direction  of  search.  The 
situation  is  pathological  because  we  do  not  expect  a  decision  maker  to  be  satisfied 
with  a  solution  that  is  nonoptinal. 


x 


2 


* 

X 


Fig.  1  . 
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Even  if  the  diagram  is  less  pathological  (Fig. 2)  there  is  still  and  almost 
preferred  solution  at  .  The  third  condition  on  S  which  will  guarantee 
a  preferred  solucion  is  that  the  asymptotic  cone  of  S,  A  (S)  ,  contains  Y 


This  implies  insatiability  of  preferences  in  the  direction  of  every  possible 
optimizing  vector  (Fig. 3).  That  it  is  insufficient  merely  to  have  nonempty 
intersection  of  the  cones  is  shown  in  Fig.  k  ,  where  there  is  an  almost  preferred 
solution  at  x^  .  It  is  evident  that  these  Lnree  conditions  are  not  necessary 
for  a  preferred  solution  -  merely  sufficient. 


Fig.  3. 
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Fig.  k. 

Theorem  3  Let  X  be  the  set  of  solutions  to  (3)-  Let  xu  e  X  be 

any  such  solution.  Then 

(i)  If  S  is  convex,  X  PS  J  0  and  Y  cr  A(S)  a  preferred  x 
can  be  produced. 

JL 

(ii)  If  X  PS  =  0  an  almost  preferred  x  can  be  produced. 

(iii)  Otherwise,  either  a  preferred  or  an  almost  preferred  x  can 
be  produced. 

Proof  (i)  Suppose  x°  ^  S  .  The  vector  d'  can  be  specified  by  DM2  , 

and  k'  >  0  is  a  scalar.  Let  x°  +  k°d°  e  S  be  the  closest 
point  of  S  to  x°  .  If  x°  +  k°d°  ^  X  let  x^  be  the 

closest  point  of  X  to  x  +  k°d  .  If  x  +  k  d  e  X 
let  x'  =  x°  +  k°d°  .  Suppose  x^  ^  S  .  By  the  convexity 
of  S  there  exists  a  unique  point  x'  +  k^d'  e  $  which 

is  the  closest  point  of  5  to  x  .  If  x'  +  k^d^  85  x°  +  k°d° 

* 

a  hyperplane  separating  X  from  S  could  be  defined,  for 

by  the  lemma  X  is  a  simply  connected  subset  of  a  convex 
body  either  wholly  contained  in  S  or  closed  with  respect 
to  S  since  Y  C  A(S)  .  Hence  the  points  x'  +  k'  d'  are 


0  w 
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not  in  T  .  Also  d(x'  +  kV,  x')  <  d(x\  x°  +  k°d°) 

<  d(x°  +  k°d°,  x°)  .  Consequently  a  sequence  of  pairs 

(x\  x'“'  +  k'-'d'-')  for  I  >  1  can  be  defined.  Suppose 

?  ;  i_i 

x  iS.  Then  the  sequence  is  countable  and  d(x  ,  x  + 

j|||  | 

k  d  '  )  is  strictly  decreasing.  Hence  1 im  x  e  § 

i-« 

oo  ^ 

and  some  x  arbitrarily  close  to  the  limit  is  in  X  pS  . 

Let  x  =  x'  if  x'  e  S  ,  or  x°°  otherwise.  Then  by 

LP1  x  can  be  produced  in  a  finite  number  of  iterations, 

and  by  DM1  it  is  recognized  as  preferred. 

(i?)  Let  x'  +  k 1 d '  be  defined  as  in  case  (i).  Construct  a 

...  /i  i-1  ,  i  -1  .  i  -1  \  _ .  . 

similar  sequence  (x  ,  x  +  k  d  ).  Since  there  is 

ft 

no  convexity  assumption  on  S  and  since  X  OS  *  t  , 

..  ,  k  k  k  k+1  .  k+1  k+1 

there  may  be  some  x  +  k  d  ~  x  +k  d  .This 

k  k+1  k+i 

implies  that  x  =  x  -...=  x  =. . . ,  i  >  1  .  Let 

ko  k  k+1  k+i  ko 

x  =  x  ■  x  =...=  x  =....  If  x  does  not 

.  *  ,  /  i  i+1  ,  i-l.i— lv  .  . 

exist  then  d(x  ,  x  +  k  d  j  is  a  sequence  strictly 

decreasing  to  some  limit*^-  >  0  .  As  d  approaches^,  x' 

approaches  some  limit  X°°  since  X  is  bounded.  Let 

x*  =  xk°  or  x°°  whichever  is  defined.  Then  by  LP1  x 
can  be  produced  in  a  finite  number  of  steps,  and  by  DM1 

it  is  recognized  to  be  not  preferred. 

(iii)  This  case  follows  case  (ii)  except  that  either 

a)  x '  e  S  or 

b)  <4  =  0  may  occur  since  X  flS  1-  t  .  Referring  to 

case  (i)  ,  if  either  a)  or  b)  occurs  a  preferred 
solution  is  the  outcome;  otherwise,  as  in  case  (ii) 
the  solution  is  almost  preferred.  Ill 
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The  converse  to  Theorem  3  is  trivial: 

Corollary  3  If  a  solution  to  (2')  exists  then  it  is  some  x  e  X“  . 

Before  attacking  the  method  of  solution  proposed  in  Section  5,  the  reader 
is  cautioned  to  recall  that  any  x  e  X  is  a  solution  to  (2M)  ,  given  the 
appropriate  X  .  However,  the  simplex  method  produces  only  extreme  point 
solutions^  If  S  contains  an  extreme  point  LP  will  find  it,  but  if  S  contains 
no  ex  reme  point  and  S  n  X'  ^0  the  simplex  method  will  have  LP  oscillating 
across  S  indefinitely.  Clearly  DM  must  take  some  linear  combination  of 
extreme  points  himself  in  this  case. 

5.  The  Method  of  Solution 

If  we  accept  the  assumptions  and  conditions  on  T  ,  S  ,  Q  ,  DM  ,  and  LP 
so  far  discussed  we  have  shown  that  a  solution  x  POAP  can  indeed  be  found. 

Without  loss  of  generality  we  can  restrict  ourselves  to  the  case  in  which  S 
contains  an  extreme  point  of  T  .  If  S  does  not  contain  an  extreme  point  DM 
can  terminate  when  by  DM2  he  must  reverse  direction;  and  if  an  almost  preferred 
solution  is  produced  DM  can  terminate  when  LP  can  propose  no  solution  in 
the  direction  specified. 

By  solving  (2 1 )  we  are  trying  to  define  an  optimum  in  terms  of  the  decision 
maker's  preference,  and  then  to  find  a  function  which  will  yield  this  optimum, 
rather  than  to  find  an  optimizing  function  and  insist  that  the  decision-maker 
like  it.  We  are  granting  him  intuition  and  knowledge  that  he  has  withheld  from 
the  computer,  unwittingly  or  otherwise--after  all,  it  was  this  intuition  and 
knowledge  that  made  him  a  decision  maker  in  the  first  place. 

Why  then  bother  with  X  at  all?  A  very  simple  approach  could  be  select 
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1  2 

any  extreme  point  x  ,  rejecting  it  and  selecting  x  and  some  direction 
1  12  1 

of  improvement  d  such  that  d  (x  -  x  )  >  0  ,  and  continuing  until  no 
n+l  . 

such  that  dn(xn  _  xn)  >  q  can  be  found.  Then  xn  is  clearly  optimal 
by  the  convexity  of  T  . 

If  we  follow  this  approach,  though,  we  find  that  the  solution  to  the  t*^ 

sequential  problem  is  a  lengthy  in  computation  and  as  tedious  and  demanding 

on  the  decision  maker  as  the  first  problem,  even  thouqh  the  solutions  may  be 

very  close.  For  example;  in  January  a  manufacturer  or  automobiles  decides, 

after  investigating  many  extreme  point  solution,  that  it  is  preferred  to 

produce  700  Rolls  Royces  and  400  Bentleys.  Now  in  February  he  notices  that 

management  policy  remains  the  same  and  that  all  his  unit  costs  and  unit  profits 

are  in  the  same  proportion.  Consequently,  he  decides  that  rather  than  reinvestigating 

all  the  extreme  points  anew  he  will  again  select  x^  =  (700,400)  .  However, 

he  discovers  very  quickly  that  either  x'  is  infeasible  for  February,  or  that 

2 

it  is  not  optimal:  he  could  find  some  better  x  which  is  preferred.  He 
realizes  that  conditions  (a)  through  (e)  of  Section  2  hold.  He  sees  that  the 
January  problem  could  have  been  solved  by  (21)  for  some  X°  ,  and  if  he  knew 
X°  ,  (21)  using  X°  and  T  for  February  would  offer  him  a  solution  close  to 
x'  that  would  be  both  feasible  and  optimal.  Further  reflection,  and  an 
understanding  of  linear  programming,  tells  him  that  in  general  X°  is  a  point 
in  a  closed  convex  set  A  and  any  XeA  would  have  solved  the  January  problem. 

Also,  calling  A  in  January  Aj  ,  there  must  be  some  A2  for  February,  and  it 
is  irmediate  that  A,  and  A2  are  not  necessarily  equal.  It  would  be  folly 
to  select  arbitrarily  x'  from  Aj  and  to  hope  that  x'  would  also  be  in  A2  • 

But  now  he  recalls  condition  (e)  which  tells  him  that  there  is  some  X  which 
is  most  likely  to  be  in  the  intersection  of  many  of  the  At  •  and  that  X 
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is  the  mean  of  all  successful  >.  to  date. 

We  can  find  a  way  to  estimate  X  .  Suppose  we  are  solving  the  first 
sequential  problem.  We  start  with  xj  ,  an  arbitrary  estimate  of  X  ,  and 

produce  an  x'  which  minimizes  X J  Qx  •  Suppose  x'  is  not  POAP.  We  modify 

12  2  2  nl 

Xj  to  Xj  and  produce  an  x  which  minimizes  X^Qx  •  .  .  until  x  which 

...  nl 

minimizes  Xj  Qx  is  POAP  .  When  we  solve  the  second  problem  clearly  the 

nl 

best  value  of  X  with  which  to  begin  is  X  ^  ,  since  all  the  sequential 

problems  are  of  the  same  class.  If  then  the  solution  to  the  second  problem  is 

n2  1  ni  n2 

attained  using  X^  ,  we  will  begin  the  third  problem  using  X^  -  ?(Xj  +  ) 


th  ]  |  *  n . 

Similarly  the  t+1  problem  would  be  entered  using  X  =  -  E  >  l=  ^ 

t  ^  I  t  •  •  t 

1  =  1 

(If  we  were  to  waive  the  assumption  of  time  invariance  of  S  the  mean  X 

-  .  -  .  i 

might  be  a  weighted  mean.)  As  t  becomes  large  X^  approaches  X  in  Cesaro 
limit,  and  X  is  the  maximum  likelihood  estimate  of  X  which  will  minimize 
XQx  and  produce  a  POAP  x  . 

Consider  the  t+l*^  sequential  problem.  The  first  solution  offered  x^  , 
minimizes  ^Qx  over  T^  .  Henceforth  the  subscript  on  X  will  be  dropped 

where  no  ambiguity  can  result.  If  x'  is  preferred  the  problem  is  solved  and 

th  1  2 

X  remains  unchanged  for  the  t+2  problem.  If  x  is  not  preferred,  x  such 

1  2  1 

that  d  (x  -  x  )  >  0  is  to  be  found. 


6.  The  Generation  of  x 


i  +  1 


The  problem  to  which  x'  is  the  solution,  using  X1  ,  is 


mi  n  z 

Subject  to  Ax  =  b 
x  >  0  . 

X  '  Qx  =  z 
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Rearranging  columns  so  that  the  first  m  columns  are  the  basis 


B.  we  have 

i 


where  subscript  B  corresponds  to  basic  variables  and  subscript  C  corresponds 
to  nonbasic  variables.  The  solution  x'  is  found  by  premultiplying  both  sides  by 


x'  =  (B^b  ,  0)  . 


Now  suppose  that  DM  specifies  direction  vector  d  =  (dg  ,  d^  )  .  That  is  to 

i+1  i  1  i 

say  that  d(x  -x  )  >  0  can  be  considered  an  additional  constraint  to  the 

problem.  Of  course,  if  we  were  to  try  to  resolve  the  problem  using  this  constraint 

we  would  succeed  merely  in  shifting  x'  an  infinitesimal  distance  in  the  required 

direction;  but  we  will  use  the  constraint  to  determine  which  variables  can  enter 

the  basis  (B.+^)  f°r  x'  +  '  • 

There  is  no  further  need  to  maintain  the  iteration  affix  (i)  everywhere, 
since  henceforth  the  analysis  will  be  based  on  solution  x'  .  We  rewrite  (7): 
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Theorem  4 


Proof 


If  a  solution  x'  ^  exists  x6  will  enter  the  basis  (B.+j)  for 
|  +  |  f  0  _  ]  0 

x  only  if  d^.  -dgB  C  >  0  ,  where  e  denotes  a  column  of  C  . 

Rewrite  d(x'+^-x')  >  0 

i  +  1  .  i 

as  dx  >  dx  . 

we  have  x*  =  (B  ^ b , 0 ) ;  yielding 

dx  -  s  =  dgB  ^b  +  e  (e>0)  ,  where  s  is  a  nonnegative  slack  variable. 
Add  the  constraint  into  (71)  ,  yielding 


(8) 


— jn 

CD 

1 

o 

°J 

"xb" 

~B_1b 

dB  dC 

xc 

= 

dgB  lb+e 

0  x(qc-qbb',c)  o_ 

-  S  - 

_  z-XQgB-^  b- 

Reducing  (8,'  to  canonical  form  by  premultiplying  both  sides  by 


(9) 


I 

0 

0 

-dB 

I 

0 

we  have 

_0 

0 

I  _ 

I 

CO 

o 

o' 

V 

'  B-1  b 

0 

dC_dB 

B_1C 

-1 

xc 

e 

.0 

><V 

v''c) 

0. 

_  s  - 

-z-XQ^B  'b- 

The  m+1  row  of  the  system  (second  row  of  the  matrix  (9/)  is  infeasible  since 

the  value  of  the  nonnegative  slack  s  is  -e  ,  (e>0)  .  To  restore  feasibility 

6  0  _  |  0 
x  must  enter  the  basis  with  positive  value;  hence  dr  -  dRB  C  >  0  .  Ill 
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e  -1  e  i+l 

Corol lary  4  If  -  dgB  C  <0  for  all  e=m+l,...,n  then  no  feasible  x 

*  ^  |  | 

can  be  found  that  will  minimize  (2  1 )  subject  to  d(x  -x  )  >  0  . 
So  corollary  4  can  be  the  criterion  by  which  the  decision  maker  determines 
x  to  be  almost  preferred  and  terminates. 


0 

Now  suppose  that  some  x  can  be  found  to  enter  B.  +  j  .  As  e  increases 

e  ' 

so  does  xe  until  some  x  ,c^  =  l,...,m  ,  is  reduced  to  zero  and  is  driven  out 

of  the  basis. 


x'  is  the  solution  to  (211)  using  a  given  .  Since  we  are  going  to  modify 
to  produce  our  next  solution  x'  +  ^  ,  we  must  have  some  properties  of  X  . 


Let  A  -  {X|X.>0  ,  I  X  =1} 

K  k=l  k 

Let  X  be  some  value  of  X  such  that  x  minimizes  X  Ox  ,  x  eX 
v  p  v  p 

Let  A  -  fXlx  minimizes  XQx  ,  x  eX  }  ;  X  eA 

V  p  p  V  V 


Theorem  5  The  number  of  distinct  A  is  finite.  A  is  closed  and  convex. 

- e-  v  V 

A  =  UA  .  No  A  is  disjoint, 
v  v 

v 


Proof  Suppose  x  is  an  extreme  point  of  T  .  The  number  of  extreme 


points  is  finite.  Suppose  x  is  not  an  extreme  point,  i.e., 


x  is  a  linear  combination  of  extreme  points.  From  the  proof  of 
M- 

Theorem  2,  given  a  linear  combination  of  extreme  points  x 


supporting  T  ,  (£ft  x  ,  3  >0  ,  7B  “0  *  the  set  of  a  as  defined 

P  P  P-  M. 

in  Theorem  2  is  independent  of  the  positive  weights  (B  )  in  the 


combination.  The  number  of  combinations  of  x  with  positive  ft 

H  p 

is  finite.  X=  71^17  yields  the  same  minimizer  as  a  •  Suppose 

I 
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A,Q*  is  minimized  by  x  and  A«Qx  is  also  minimized  by  x  . 

1  p  2  ii. 


4 


Let  Aj  and  A^  e\  ’  ^1^  “  C|  ’  ^2^-C2  '  ^  ’S  a  we^-*<nown 

result  that  [0  c,  +  ( 1  -ry)  c0  ]x  is  also  minimized  by  x  ,  where 

I  ^  p 

0  <  o'  <  1  •  Hence  [q-A,  +  ( 1  -rv) >.0  ]Qx  is  minimized  by  x  and 

~  -  12  p 

Av  is  convex.  Suppose  the  sequence  A^  ,  ^Qx , . . . ,  At0x- . . . 

is  minimized  by  x  ,  where  A,  ,  A.  , . . . ,A„ . . • .-A  ;  A,  ,  A0  , . . . 

(i  1  2  t  12 

A.>***eA  •  Then  c,x  ,  c_x, . . . ,c  x, . . .  is  minimized  by  x 

tv  1  2  t  p  . 

If  c,  ,  c„ , . . . ,c  , . . c  then  cx  is  minimized  by  x  since 
I  2  t  p 

both  T  and  z  =  cx  are  closed.  Hence  A  is  closed. 

v 

From  the  definitions  A  c  A  •  Suppose  there  exists  some 

v 

A°  e  An(UA  )C  .  Then  no  x  is  minimized  by  A°Qx  ,  which 
v  V  ^ 

contradicts  the  compactness  of  T  .  Suppose  some  A^  is  disjoint. 

Then  A  ~  A  is  not  closed;  but  the  union  of  closed  sets  is  closed./// 


Suppose  that  A  is  an  element  of  A  .  We  must  find  some  Ae/^,  which 
will  generate  x  subject  to  the  conditions  of  Theorem  4.  We  know  that 
A  is  the  most  likely  value  to  use  to  achieve  our  aim,  but  we  also  know  that 
A  will  not  work  because  we  have  already  tried  it.  Consequently,  we  try  some 
AeA  1  such  that  f  I A - \ I  I  is  minimized,  considering  only  those  A  which 

V  1  1  1  1 

generate  x'+^  subject  to  the  constraints  of  Theorem  4. 


Let  us  formalize  the  conditions  on  the  new  A  ■  Let  E  be  the  set  of 
columns  of  C  satisfying  the  conditions  of  Theorem  4.  For  notational  simplicity 
we  drop  the  superscript  of  A  ;  where  no  affix  exists  we  refer  only  to  the  new 
A  that  we  are  seeking.  Suppose  that  we  can  generate  x*  using  AeA^i  •  Then 
the  canonical  set  of  equations  is  still  (7 1 ) ,  although  the  value  of  A  is  not 
identical.  Let  the  value  of  A*  used  to  generate  x  originally  be  in  A^ 

What  can  we  say  from  this?  Firstly,  the  solution  is  x  since  x=(B  b,0)  . 


2b 


Secondly,  since  x'  is  optimal  XfQ^-QgB-  C)>0  .  Thirdly,  XeAv  •  But  from 
Theorem  5  we  know  that  there  exists  some  XeA  Ha  .  .  Consequently,  this 

V  V 

choice  of  X  from  A^HA^i  is  possible  and  justified.  We  can  say  then  that 


(10) 


-1 


xCW  c)-° 

x>o 


E  X.  =  1 
k=i  k 


and  also  (a)  that  there  is  at  least  one  equality  in  the  first  row  of  ( 1 0) , 

and  further  (b)  that  equality  corresponds  to  a  column  in  E  .  In  addition  we 

o 

have  an  objective  --  to  minimize  E(X,  -X.J*  .  So  we  have  something  that  looks 

K  K 

like  a  quadratic  program.  From  the  optimality  properties  of  x  it  is  clear 
that  there  is  a  one  to  one  correspondence  between  the  columns  of  C  and  the  rows 
of  (10).  It  follows  that  if  column  j  is  in  E  then  row  j  of  the  first 
line  of  (10)  is  eligible  for  equality.  For  simplicity  of  notation  we  will 
write  that  row  j  is  in  E  . 


Let  us  simplify  (10)  into  a  quadratic  program  by  removing  the  additional 
constraints,  (a)  and  (b): 


(10 


m  i  n 

e(x 

A>2 

subject 

to 

RX<0 

x>o 

EXk=l 

where  R  =  -(Q^-QgB  ^C) 


By  inspection  the  optimal  solution  is  X=X  ,  the  point  from  which  we  started. 

P 

The  constraint  set  has  an  interesting  geometrical  interpretation.  In  R  all 
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solutions  X  1  ie  on  the  intersection  of  the  hyperplane  EX^l  and  the  nonnegative 
orthant.  A  solution  to  ( 1 0)  is  found  when  a  point  X  lies  on  one  of  the 
admissible  feasible  RX=0  (row  e  E)  while  remaining  as  close  to  X  as  possible. 
If  no  such  point  can  be  found  then  case  (ii)  of  Theorem  3  holds.  If  X  lies 
on  the  axis  of  the  orthant  a  solution  (in  general)  does  not  exist  there  since 
A^r Av i  is  not  necessary  at  the  boundary  of  A  ,  hence  a  change  of  basis  in  (7) 
does  not  occur. 

We  set  up  the  system  of  equations  to  solve  ( 1 1 )  by  Wolfe's  method  of 
quadratic  programming,  adding  slack  variables  o>0  ;  multipliers  tt  and 
complementary  slack  variables  v  ,  complementary  to  (X,c)  : 


The  matrix  contains  2(n-m)+p+l  rows  and  3(n-m)+2p+l  columns.  We  have 
already  established  that  there  exists  a  solution  in  nonnegative  X  ,  a  , 
unrestricted  rr  and  zero  v  which  is  optimal  both  a  fortiori  and  by  the  Wolfe 
optimality  criterion  of  (X,rr)'v=  0  .  Hence  by  Gauss-Jordan  elimination  or 
simplex  phase  1  we  make  the  first  n-m+k  columns  basic,  and  immediately  obtain 
the  tableau  corresponding  to  the  solution  X=X  : 

1  ^1  ,s+l . Y  1  ,s+n-m+p 

•  •  • 

«  •  • 

03) 

^  s  ,  s+n-nH-p 


^s ,s+l 
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where  s=2(n-m)+p+l 

are  nonnegative  values  of  X 

_2  . 

B  are  nonnegative  values  of  a 

3 

B  are  unrestricted  values  of  rr 


7.  The  Computation  of  X 


We  recall  in  (ll)  that  it  is  sufficient  for  one  inequality  to  be  an 

equation,  provided  its  row  e  E  ,  to  yield  a  solution  for  X  .  Suppose  row 

j  eE  ,  ind  the  j  ^  inequality  of  (10)  is  an  equation.  Then  a.  =  0  and 

v  enters  the  basis.  From  the  last  row  of  (12): 

P+J 

TT.  =  V  .. 

J  P+J 

a.  and  v  ..  cannot  simultaneously  be  in  the  basis  hence  the  pivot  operation 
J  P+J 

entering  v  and  expelling  a  must  be  on  y^  s+p+j  •  From  Kuhn -Tucker  theory 

we  obtain  that  the  multipliers  tt.  are  nonpositive,  hence  v  ,  .  <  0  (since 

J  P+J  - 

the  solution  will  be  nonoptimal  with  respect  to  the  Wolfe  algorithm).  Since 

a.>0  before  the  pivot  and  v  .  .  <0  after  the  pivot 
J  P+J  - 

y  ,  .  ,  ,  .  <  0 

YP+J  ,  s+p+j 

From  the  arithmetic  of  pivot  operations,  referring  to  (13) 


b'  -  B,'  -  yk‘s+P+i  B2 

Yp+j,s+p+j 


P  +  j 


6p*j' 


P  +  j 


p+j 1 

iVi 


Y 


P+j  '  ’S+P+j  B2  .  where  j  j 

r\  4-  i  J  J 


P+J -s+P+J 


P+J 


P+j  ,  S  +  p+j 
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To  maintain  feasibility 

and 


0  <  B.1  <  1 

—  k  — 

2 

0  <  B 

-  k 


We  have  thus  found  the  conditions  by  which  may  leave  the  basis. 

The  steps  are: 


1) 

Ident i fy 

jeE 

2) 

El imi na*e 

j  » 

Yp+j  ,s+p+j  >  0 

3) 

El iminate 

j  * 

<  0  or  B|J_  >  1 

4) 

El  iminate 

j  » 

B?,  <  0  ,  j V  j  . 

Those  that  survive  the  test  are  feasible  and  we  wish  to  minimize  the 

deviation  from  X  .  It  is  sufficient  to  minimize  since  the  expression 

2 

is  monotone  with  respect  to 

We  have  found  values  of  X  ,  if  they  exist,  which  will  make  a  new  basis 
in  (ll)  as  desired  as  the  current  basis.  In  order  to  precipitate  the  change  we 
replace  X  by  X+e(X-x')  where  e  is  small  and  positive.  Clearly  e(X-x') 
sums  to  zero.  Nov  suppose  another  iteration  is  required.  X  computed  on 
the  first  iteration  becomes  X*  ^  and  a  new  value  of  X  is  desired.  R  will 
of  course  be  different  since  it  is  derived  from  the  x*  .  We  follow  the  exact 
procedure  as  in  the  first  iteration,  forcing  a  basic  solution  in  the  first 
n-m+p  columns.  This  will  not  be  optimal  since  X  is  excluded  from  the  constraint 
set.  Consequently  there  will  be  at  least  one  value  of  a  <  0  .  Again  using 
Theorem  U  we  find  that  value  of  v  ,  if  any,  which  satisfies  the  conditions  for 
p i vot i nq . 

8.  Termi nation 


There  are  three  ways  of  terminating  the  procedure. 
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Case  I .  The  decision  maker  accepts  x  produced  by  minimizing  XnQx  .  Then 

Vi  -  <tx,  +  V,)/(t+,) 

Case  II.  The  program  can  find  no  v  to  bring  into  the  basis  which  satisfies 

the  pivoting  rules.  Then  case  ii  of  Theorem  3  applies  and  the  last  x  is  the 

best  that  can  be  provided. 

Vi  =  (txt  +  Ci)/(t+,) 

as  i n  case  I . 

Case  III.  The  decision  maker  causes  cycling  between  a  number  >2  of  solutions. 
This  implies  that  S  does  not  contain  an  extreme  point  and  the  decision  maker 

must  interpolate  points  of  the  cycle  £  . 

Vl  =  (tXt  +  I  Xt+I  /  I  I  5l  I  )/(t+T)  . 

9-  Numerical  Example  see  figure  5- 

A  very  simple  example  is  illustrated: 

A  constraint  set  T  cC^c^? 

■X]  +  2x2  <  4 

x j  +  1/2x2  <  6 

2x]  -  x2  <  4 

yielding  a  minimum  at  (*+.*+)  under 
1 

c  x  =  -x] 

2 

c  X  =  -X2 

X1  =  X  =  (1/2 ,1/2) 

The  t+1  sequential  problem  contains  Vi  c  ct+,  : 
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“X 1  +  2x2  <  4 
*]  +  2x2  <  6 

2xl  ~  x2  -  ^ 


The  optimal  solution  is: 


- 

— 

1 

0 

0 

1/5 

2/5 

14/5 

0 

1 

0 

2/5 

-1/5 

X 

. 

8/5 

0 

0 

1 

-3/5 

4/5 

18/5 

0 

0 

0 

3/10 

1/10 

J 1  /  5_ 

producing  x  =  (14/5,  8/5)  which  is  not  in  S  .We  wish  to  increase  at  least  x„ 


and  write  cl  a  =  x^  >  8/5  • 


6  -*16 

We  compute  d^  -  dgB  C  for  x^  and  x 


5  * 


d4  -  dBB_1C4  =  0  -  [0  1  0] 


d5  -  dBB_1C5  =  0  -  [0  1  0] 


1/5 
2/5 
L-3/5 

'  2/5 
-1/5 
L  4/  5  J 


-2/5 


1/5 


Only 


is  permitted  to  enter  the  basis 
We  calculate  QgB 

=  -10  0 
0-10 


-1/5 

-2/5 

-2/5 

1/5 

"  1/5 
2/5 
--3/5 


2/5' 

-1/5 

V5_ 


0  0 
0  0 
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We  add  slacks  a  >  0  yielding  (11) 


min  (X, -i)2  +  (X2-i)2 

subject  to 

'-1/5 

-2/5 

1 

-2/5 

1/5 

0 

.  1 

1 

0 

We  have  seen  that  only  x,.  can  enter  the  next  basis,  x,_  is  the  second 
column  of  C  ,  so  E  =  {2]  .  We  reach  the  tableau  (13);  showing  y.^  and  the 


1/4 

-1/4 

-1/20 

3/20 

0 

0 


p=2  ,  j=2  so  we  inspect  y ^  ^ 
So  far  a  pivot  is  feasible. 

.1  m 


1/20 

-1/20 

-1/100 

3/100 

-1 

0 

-3/10 
=  -9/100 


1/10 

-9/100 


-3/20 

3/20 

3/100 

-9/100 

0 

-1 

-1/10 


i  +  ]0 
l  9 


-3/20 

3/?0 


B  =  3/10  -  (3/1 00) (-10/9)  =  1/3 
So  X2  =  (1/3  -  e/6  ,  2/3  +  e/6) 

We  re-enter  the  primal  problem  with  objective  min  ((-1/3  +  e/6xj+(-2/3-e/6)x2) 
and  obtain  x  =  (1  ,5/2)eS  . 
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